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FILTERING DEVICE AND METHOD FOR REDUCING NOISE IN ELECTRICAL 
SIGNALS, IN PARTICULAR ACOUSTIC SIGNALS AND IMAGES 

BACKGROUND OF THE INVENTION 

Field of the Invention 

The present invention refers to a filtering device and method for reducing 
noise in electrical signals, in particular acoustic (voice) signals and images. 

Description of the Related Art 

As is known, filters operating according to various linear and nonlinear 
techniques are used to remove undesired components from electrical signals. In particular, 
undesired components may be any type of noise (white noise, flicker, etc.) or other types of 
superimposed acoustic or visual signals. 

Linear filters are at present the most widely used instruments for filtering 
noise. Finite-impulse filters (FIRs) eliminate all the harmonics of a signal having a 
frequency higher than the cutoff frequency of the filter and improve the signal-to-noise 
ratio (SNR). Another linear filtering technique is based on the fast Fourier transform 
(FFT), where the signal is transformed into the frequency domain, the undesired harmonics 
are removed, and then the inverse Fourier transform is calculated. 

As far as nonlinear techniques are concerned, average filters are simple to 
design and may be implemented through simple hardware circuits. Average filters are 
based on the comparison of the individual signal samples in an time interval with the 
average of all the samples in the same time interval. On the basis of this comparison, the 
individual samples are selectively attenuated. 

All these methods share the disadvantage that, when removing the noise, 
also some of the components of the original signal are removed. 

Furthermore, none of the current techniques, whether linear or nonlinear 
ones, including average filtering, is able to preserve steep edges of the signal. If a moving- 
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average filter is used, the width of the window must be very small if steep edges are to be 
preserved. However, if the size of the window becomes small, there is no significant 
reduction in noise energy. If linear filters are used, all the frequencies above the cutoff 
frequency are eliminated, with consequent marked distortion of the signal. 

5 BRIEF SUMMARY OF THE INVENTION 

The embodiments of the invention provide a filtering method and device 
that does not cause a sensed deterioration of the signal and at the same time preserves the 
edges of the signal. 

The filter and the method described are particularly useful in the case of 
10 signals having steep edges, for which the aim is to preserve the edges of the signals. 
Furthermore, it is possible to filter signals affected by white and non-white noise, such as 
flicker noise. Through the present method it is moreover possible to eliminate from a 
signal other signals that are superimposed on it and are characterized by a wide spectral 
range. 

1 5 The device and the method described are based upon a neuro-fuzzy network. 

They are implemented with a moving-average filtering technique in which the weighting 
factors (or weights) for the final reconstruction of the signal are calculated in a neuro-fuzzy 
network according to specific fuzzy rules. This enables a better reduction of the noise. The 
fuzzy rules operate on different variables, referred to as signal features. Described 

20 hereinafter are three signal features and six fuzzy rules. 

The proposed filter is suitable for visual signals or acoustic signals, even 
ones with sudden variations. Various types of functions or signal features can be used to 
create the rules. With the method described, the signal features are correlated to the 
position of the sample in the considered sample window, to the difference between a given 

25 sample and the sample at the center of the window, and to the difference between a given 
sample and the average of samples in the window. These signal features may have a 
considerable influence on the values of the weights for the reconstruction of the signal; in 
addition, they may be calculated in a relatively simple manner. 
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The method and the filter according to the invention moreover comprise a 
neuro-fuzzy filter bank. In this way, the signal may be split into different sub-bands 
according to wavelet theory: Each sub-band signal may be filtered by a neuro-fuzzy 
network, and then the various sub-bands can be reconstructed by the synthesis filter bank. 
5 As is known from wavelet theory, in the first sub-band the signal features have a low 
frequency, whereas in the last sub-band the signal features have the maximum frequency. 
If non- white noise (colored noise) is to be removed, this is approximated by white noise in 
each individual sub-band. Given that a neuro-fuzzy network works well on white noise, 
this solution leads to a sensible reduction in noise. 
10 The network is trained by supplying some configurations of input and 

output signals (the configuration of the output signal that it is required to obtain as a result 
of the network evolution is called target configuration). The training algorithm is based 
upon one of the known learning methods, such as gradient descent, a genetic algorithm, the 
simulated annealing method, random search, or any other method for function optimization. 



1 5 BRIEF DESCRIPTION OF THE SEVERAL VIEWS OF THE DRAWING(S) 

For an understanding of the present invention, preferred embodiments 
thereof are now described, purely to furnish non-limiting examples, with reference to the 
attached drawings, in which: 

Figure 1 is a block diagram showing the general architecture of the filter 
20 according to the invention; 

Figure 2 represents the topology of a block of Figure 1 for a neuro-fuzzy 

network; 

Figures 3A and 3B show a flowchart of the operations performed by the 
filter of Figure 1; 

25 Figure 4 shows a block diagram of a filtering device using the fdter of 

Figure 1; 

Figure 5 shows the transfer functions of digital filters belonging to the 
filtering device of Figure 4; 
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Figure 6 shows the block diagram of some digital filters belonging to the 
filtering device of Figure 4; 

Figure 7 shows a block diagram of another filtering device using the filter of 

Figure 1; 

5 Figure 8 shows a flowchart of the operation of the filtering device of 

Figure 7; 

Figure 9 shows a block diagram for the hardware implementation of the 
filter of Figure 1; and 

Figures 10A, 10B, and IOC respectively show a voice signal free from noise, 
10 the same signal superimposed on white noise, and the same signal after filtering according 
to the invention. 

DETAILED DESCRIPTION OF THE INVENTION 

Figure 1 shows a filter 1 comprising a signal-feature computation unit 2, a 
neuro-fuzzy network 3, a reconstruction unit 4, and a training unit 5. 

15 The signal-feature computation unit 2 receives at the input a signal In 

including of a plurality of input samples e{i), stores, at each clock cycle, (2N+ 1) input 
samples e(i) (which represent a work window for filter 1) in an internal buffer, computes 
the signal features Xl(z'), X2(f), and X3(i) for each input sample e(f) on the basis of all the 
input samples belonging to the work window (as described in detail hereinafter), and 

20 supplies the signal features Xl(/), X2(i), and Xi{i) thus calculated to the neuro-fuzzy 
network 3. 

The neuro-fuzzy network 3 processes the signal features XI (i\ X2(i), and 
X3(i) and generates at the output a reconstruction weight oL3{i) for each input sample e(f). 
To this aim, starting from the signal features XI (z), X2(i), and X3(i) and for each input 
25 sample e(f), the neuro-fuzzy network 3 first performs a fuzzification operation, then applies 
preset fuzzy rules, and finally carries out a defuzzification operation. The reconstruction 
weight oL3(i) thus obtained is hence the weighted sum of all the input samples e(i) in the 
same work window, as explained in detail hereinafter with reference to Figures 2 and 3. 
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The reconstruction unit 4 receives the reconstruction weights oL3(i) and the 
input samples e(i) and, after accumulating a sufficient number of input samples e(f) and of 
corresponding reconstruction weights oL3(i), generates an output sample u(i) the sequence 
of which forms an output signal Out. 

The training unit 5 is operative only initially, so as to train the neuro-fuzzy 
network 3 and modify the weights of the network with the aim of obtaining an optimal 
behavior of the filter 1, as described in detail hereinafter. 

The signal features Xl(f), X2(i), and X3(i), computed in the signal-feature 
computation unit 2, are correlated, respectively, to the distance between each sample and 
the central sample of the considered window, to the difference between a given sample and 
the sample at the center of the window, and to the difference between a given sample and 
the average of samples in the window, and are normalized so as to obtain values between 0 
and 1. 

In detail, given a window of (2N+ 1) input samples e(i), with i = 0, 2N, 
the signal features X\ {i),X2{i), andZ3(0 for each input sample e{i) are defined as 

\i-N\ 
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max(aiff_av) 

where N is the position of a central sample e(N) in the work window; 
max (difjf) = max (e(k)-e(N)) with k = 0, 2N, i.e., the maximum of the 
differences between all the input samples e(k) and the central sample e(N); 
av is the average value of the input samples e(i); and 

max (diff_av) = max (e(k)-av) with k = 0, 2N, i.e., the maximum of the 
differences between all the input samples e(k) and the average value av. 



The neuro-fuzzy network 3 is a three-layer fuzzy network the functional 
representation of which appears in Figure 2, in which, for reasons of simplicity, the index i 
in parenthesis for the specific sample within the respective work window is not indicated. 
Nevertheless, as mentioned above, and as will emerge more clearly from the flowchart of 
Figures 3A, 3B, the neuro-fuzzy processing represented by Figure 2 is repeated for each 
input sample e(i). 

In detail, starting from the three signal features XI, XI and X3 (or 
generically from / signal features XI) and given k membership functions of a gaussian type 
for each signal feature (described by the average value W m (l, k) and by the variance W v (l, k), 
a fuzzification operation is performed in which the membership level of the signal features 
XI, XI and X3 is evaluated with respect to each membership function (here two for each 
signal feature, so that k = 2; in all there areM= lxk=6 membership functions). 

In Figure 2, the above operation is represented by six first-layer neurons 6, 
each of which, starting from the three signal features XI , XI and Xi (generically designated 
by XT) and using as weights the average value W m {l, k) and the variance W v (l, k) of the 
membership functions, supplies a first-layer output oLl{l, k) (hereinafter also designated by 
oL\{m)) calculated as follows: 



oLl{l, k) - oLl(m) = exp 



V W v (l,k) j j 



(4) 



Hereinafter, a fuzzy AND operation is performed, using the norm of the 
minimum, in such a way as to obtain N second-layer outputs oL2(n). For example, N is 
equal to 6. As is known, a fuzzy AND operation using the norm of the minimum is based 
upon rules of the type: 

if is 4» and Xf is A™ and X? is A? then 0 is 



if is 4") and X™ is and X\ n) is A^ then O is 



in which A[ l) , Af , „ etc. are linguistic terms, such as "high" and 

"low," and the value of the output O for each rule is given by the minimum of the 
membership levels multiplied by a weight. 

In practice, with the neuro-fuzzy network of Figure 2, each second-layer 
5 output oL2(n) is equal to the minimum one among the products of the M outputs oL 1 (m) of 
the first-layer neurons 6 and a respective second-layer weight W FA (m, n). 

In Figure 2 the above operation is represented by N second-layer neurons 7 
which implement the equation 

oL2(n) = mm{W FA (m,n)-oIA(m)} . (5) 

10 Finally, the third layer corresponds to a defuzzification operation and 

supplies at output a discrete-type reconstruction weight oL3, using N third-layer weights 
W Df (ri). The defuzzification method is that of the center of gravity (centroid) and is 
represented in Figure 2 by a third-layer neuron 8 supplying the reconstruction weight oL3 
according to the equation 

f j W DF (n)-oL2{n) 

!5 oL3 = ^- N . (6) 

2>2(«) 

0 = 1 

The reconstruction unit 4 then awaits a sufficient number of samples e(i) and 
corresponding reconstruction weights oL3(i) (at least 2N+1, corresponding to the width of 
a work window) and calculates an output sample u(f) as the weighted sum of the input 
samples e(i -j), withy = 0 ... 2N, using the reconstruction weights oL3(i -j), according to 
20 the equation 

IN 

Y j oL3(i-j)-e(i-j) 

"(0 = ^— ^ • (7) 

£«('■- 7) 
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The training unit 5 operates only in an initial learning stage, when an input 
signal In having a known configuration is supplied to the filter 1, the output signal Out 
obtained is compared with a target signal Tg, and the distance between the obtained signal 
Out and the target signal Tg is evaluated on the basis of a fitness function. This fitness 
function may be, for example, the quadratic signal/noise ratio having the following 
expression: 
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SNR = Y (Tg(i) (8) 

in which T is the total number of input samples e(i). 

Using the fitness function and applying a method for function optimization, 
such as the gradient-descent method, a genetic algorithm, the simulated-annealing method, 
and random search, the first-layer weights (mean value WJl, k) and variance W v (l, k) of the 
gaussian membership functions) and the third-layer weights W DF (n) are modified, and a 
new fitness evaluation is performed. The second-layer weights W FA {m, n) are instead 
randomly initialized and are not modified. The learning process is iterated until a preset 
value of the fitness function is achieved or until a preset number of genetic algorithms have 
been generated or a preset number of steps of the selected optimization algorithm has been 
performed. 

In this way, the neuro-fuzzy network 3 implements an adaptive algorithm 
and overcomes the limitations of neural networks or of fuzzy systems considered 
separately. In fact, fuzzy systems do not have learning capabilities and, if the selection of 
the fuzzy rules is not accurate, the fuzzy algorithm does not behave satisfactorily. Instead, 
using the neuro-fuzzy network 3 and carrying out a prior learning step it is possible to 
approach a signal having a complex mathematical structure, for example the voice in a 
noisy environment, without any prior knowledge of the mathematical laws governing the 
said system. 

Operation of the filter 1 of Figure 1 is described in detail hereinafter with 
reference to Figures 3 A and 3B. 
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Initially, the filter 1 is initialized, step 10, as is a window counter p, step 11. 
Then the window counter p is incremented by (2N+ 1), equal to the number of input 
samples e(i) in a work window, step 12, and the input samples of a work window ranging 
between e(p) and e(p + 2N) are loaded, step 13. A sum-of-samples counter h is initialized 
5 at 0, and a sum-of-samples variable S(0) is initialized with the value of the input sample 
e(p), step 14. Next, the sum-of-samples counter h is incremented by one unit, step 15, and 
the sum-of-samples variable S(h) is incremented with the value of a sample e(p + h), step 
20. After the sum of (2N+1) input samples (output YES from step 21), the sum-of- 
samples variable S(h) is equal to the sum of all the input samples e(i) and may be directly 
1 0 used for calculating the signal features. 

Subsequently, using equations (1), (2) and (3) and the value of the sum-of- 
samples variable S(h), the signal features X\,X2,Xi are calculated for each sample e(p) - 
e(p + 2N) belonging to the considered work window, step 22. A sample counter / for the 
input samples within the considered work window is then reset to zero, step 23, and 
1 5 subsequently incremented by one unit, step 24; a feature counter / for the number of signal 
features used (in the present case, 3) is reset to zero, step 25, and subsequently incremented, 
step 26; and a function counter k for the number of membership functions used for each 
signal feature (in the present case, 2) is reset to zero, step 30, and subsequently 
incremented, step 31. Next, the first-layer weights (the mean value W m (l,k) and the 
20 variance W v (l, k)) are loaded, step 32, and the first-layer outputs oL\(l, k) are calculated in 
accordance with equation (4), step 33. 

Loading of the first-layer weights WJJ, k), W v (l, k) and calculation of the 
first-layer outputs oLl(l, k) are repeated for all the membership functions (output YES from 
step 34) and for all the signal features (output YES from step 35). 
25 Next > a second-layer neuron counter n is reset to zero, step 39, and 

incremented by one unit, step 40; an algorithm counter m is reset to zero, step 41, and 
incremented, step 42; and the second-layer weights W FA {m, n) for the «-th second-layer 
neuron 7 are loaded, steps 43, 44. Then, the second-layer output oL2(n) for the n-th 
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second-layer neuron 7 is calculated using equation (5), step 45, and the procedure of steps 
40-45 is repeated for all the n second-layer neurons 7. 

At the end (output YES from step 50), the second-layer neuron counter n is 
reset again, step 51, and incremented by one unit, step 52; all the third-layer weights 
W DF {n) are loaded in succession, steps 53, 54; at the end of loading (output YES from step 
54) the reconstruction weight oL3(i) is calculated in accordance with equation (6), step 55. 

The reconstruction weights oL3(i) thus calculated and the respective input 
samples e(t) are stored, step 60, and the procedure described for steps 24-60 is repeated for 
successive input samples e(i) until (2N+ 1) input samples e(f) are reached (output YES 
from step 61). 

Next, a sum counter / is reset to zero, step 62, and the input sample e(i) is 
added to the previous 2N input samples e(i -;), and the sum is stored in a variable E, step 
63. 

After the sum of (2N+1) input samples has been carried out, an output 
sample u(i) is calculated in accordance with equation 7, step 65. 

The entire cycle described by steps 12-65 is repeated as long as input 
samples e(i) are present; at the end (output YES from step 70), the sample processing 
procedure terminates. 

According to another aspect of the invention, filtering is based on a multi- 
resolution analysis obtained through a filter bank in phase quadrature. Wavelet theory 
furnishes the theoretical basis for multi-resolution. 

As is known, a multi-resolution analysis defines a set of nested subspaces of 
a square summable function space, i.e., the space of the finite-energy functions, widely 
known in physics and electrical engineering. On the basis of the above analysis, a 
projection of a function in one of these subspaces isolates the "roughest" details of the 
function, whilst projection of the function in the orthonormal complement of this subspace 
isolates the "finer" details of the function. The procedure may be iterated to obtain a 
pyramid. From wavelet theory it is known that the operation may be performed using a 
bank of FIR filters, in which each FIR filter is followed by a subsampler). The signal thus 
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split into sub-bands can be reconstructed using a bank of complementary filters, each of 
which is provided with a sample incrementer (upsampler). 

A first embodiment of the above-mentioned solution is shown in Figure 4 
and regards a multi-resolution filter 80 generating two subspaces and using a first pair of 
Finite Impulse Response Quadrature Mirror Filters (FIR QMFs) for the analysis and a 
second pair of FIR QMFs for the synthesis. 

In detail, the multi-resolution filter 80 receives, on an input 81, an input 
signal j,(f). The input signal stf) is supplied to two input FIR filters H 0 , Hi which perform 
a convolution operation so to output a corresponding filtered signal e 0 , e x equal to: 

M 

e 0 (t) = y Zh 0 (r)-i(t-r) (9) 

r=0 

M 

?! (0=XV) ■*"('-'■) (io) 

in which M is the order of the filters H Q , H; e 0 (t), e x (f) is the f-th sample of the respective 
output sequence; s,{t) is the r-th sample of the input sequence; h 0 {r), hj(r) is the t-th tap of 
the input FIR filter H Q , H u in which 

hi(r) = (-l) r - 1 h 0 (2I-r+l) 

where 7 is an integer. 

The input FIR filters H 0 , H\ have transfer functions shown in Figure 5 and 
thus define, respectively, a low-pass filter and a high-pass filter, and have the structure 
shown in Figure 6, where the generic tap h(r) corresponds to h 0 {r) or to hi{r), according to 
whether it is the input FIR filter H 0 or the input FIR filter H x . 

The outputs of the input FIR filters H Q , Hi are each connected to a respective 
subsampling unit 84, 85 which discards the odd samples from the input signal e 0 (t), e x it) 
and retains only the even samples, generating a respective signal e 0 (t), e x {t). The outputs of 
the subsampling units 84, 85 are each connected to a respective neuro-fuzzy filter 86, 87. 
Both of the neuro-fuz2y filters 86, 87 have the structure shown in Figure 1. 
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The output signals u 0 (t), u\{t) of the neuro-fuzzy filters 86, 87 are each 
supplied to a respective upsampler 88, 89 which generates a respective output signal w 0w (0, 
«i«(0 by entering a zero sample between each pair of samples of the respective output 
signal u 0 (t), u x (t) of the neuro-fuzzy filters 86, 87. The outputs of the of the upsampling 
units 88, 89 are each connected to a respective output FIR filter Go, G x . These filters too 
have each a respective transfer function given by equation (9) and equation 
(10), respectively. 

Finally, the output signals of the output FIR filters G 0 , G\ are added 
together, sample by sample, by an adder 92. 

Figure 7 shows a multi-resolution filter 95 using eight subspaces. In detail, 
the input signal s t {f) is initially supplied to two first synthesis FIR filters H m , #102, 
respectively of the low-pass type and of the high-pass type, and is then subsampled in two 
first subsampling units 96, 97, in a similar way as described for the units 85, 86 of Figure 4. 
The sequences of samples thus obtained are each supplied to two synthesis filters (and 
hence altogether to four second synthesis FIR filters H m , H n i, #013, and H m ). The 
outputs of the second synthesis FIR filters # 0 n, #m, #ob, and Hi 14 are then supplied to 
four second subsampling units 100-103, and each sequence thus obtained is supplied to two 
third synthesis FIR filters (and hence altogether to eight third synthesis FIR filters Hon, 
#122, #023, #124, #025, #126, #027, #128), generating eight sequences of samples. The eight 
sample sequences are then supplied to eight third subsampling units 107-1 14 and processed 
in respective neuro-fuzzy filters 120-127 having the structure illustrated in Figure 1. The 
sample sequences present on the outputs of the neuro-fuzzy filters 120-127 are then 
incremented via upsampling units 130-137 and supplied to respective first synthesis FIR 
filters G 0 2i, G m , G023, G124, G025, G126, G027, and G128. The sample sequences thus 
obtained are added up two by two through four adders 140-143 (with a reverse process with 
respect to the one followed downstream of the second subsampling units 100-103), 
supplied to four upsampling units 146-149, and filtered again through four second synthesis 
FIR filters G ou , G m , Goi3, and G xu . 
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The sample sequences thus obtained are added up two by two through two 
adders 150, 151 (according to a reverse process with respect to the one followed 
downstream of the first subsampling units 96, 97), incremented by two upsampling units 
154, 155, filtered through two third synthesis FIR filters G 0 oi and G W2 , and finally summed 
in an adder 160 so as to supply the output signal s 0 (t). 

Figure 8 shows a flowchart of the sequence of steps performed using a 
multi-resolution filter with a preset arbitrary number of splittings into subspaces. 

Initially, the samples of the input signal s{t) are loaded, step 160; then a 
space split counter / is initialized at -1, step 161, and incremented by one unit, step 162; a 
subspace counter k is initialized at zero, step 163, and incremented by one unit, step 164. 
Then the samples of the input signal s,(t) are filtered using the filter H Qjk (thus, at the first 
iteration, using the filter H m ), step 165, and the filtered samples are downsampled, step 
166. Next, the subspace counter k is incremented, step 170; the samples of the input signal 
s,(t) are filtered using the filter H ijk (thus, at the first iteration, using the filter H m ), step 
171, and the filtered samples are downsampled, step 172. 

It is checked whether the subspace counter k is equal to 2 (/+I) ; if it is not, the 
cycle comprising steps 164-172 is repeated (in the iterations following on the first, filtering 
is performed on the samples obtained in the previous iteration with the filter i/ 0 (/-i)(*-2) or 
#i(/-i)(*-2)); if it is (output YES from step 173), it is checked whether the splitting into 
subspaces is terminated (i.e., whether the space split counter j has reached the preset 
maximum), step 174. If it has not, the procedure returns to step 162; if it has, all the 
obtained sample sequences are filtered using the neuro-fuzzy filter of Figure 1, step 175. 

Next, the space split counter; is initialized at its maximum value plus one 
unit, step 180, and then decreased by one unit, step 181, the subspace counter k is 
initialized at zero, step 182, and incremented by one unit, step 183. Next, the first sample 
sequence at output of the first neuro-fuzzy filter (120, in Figure 7) is upsampled, step 184, 
and filtered using a filter G 0jk (thus, at the first iteration, using the filter G 02 i), step 185. 
Then, the subspace counter k is incremented again, step 190; a second sample sequence at 
the output of a second neuro-fuzzy filter (121, in Figure 7) is upsampled, step 191, and 
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filtered using a filter G ljk (thus, at the first iteration, using the filter G m ), step 192. The 
samples at the output of the filters G 0jk and G ljk are then summed, step 193. 

It is then checked whether the subspace counter k is equal to 2 (,+1) , step 194; 
if it is not, the cycle comprising steps 183-193 is repeated (processing the sample sequences 
5 at the output of the subsequent neuro-fuzzy filters); if it is (output YES from step 194), it is 
checked whether the end has been reached, step 195; if it has not, the procedure returns to 
step 181, decreasing the space split counter j and processing the sample sequences 
previously upsampled, filtered and summed. The loop defined by steps 181-194 is repeated 
until a single sequence of samples is obtained, corresponding to the output signal s 0 (t), 
1 0 output YES from step 195. 

Figure 9 shows the hardware implementation of the neuro-fuzzy filter 1 of 
Figure 1. In detail, the neuro-fuzzy filter 1 comprises a data memory 200, three work 
memories 201-203, a signal features calculation module 205, a control unit 206, a first- 
layer output memory unit 207, a second-layer output calculating unit 208, a reconstruction- 
1 5 weight calculating unit 209, and a reconstruction unit 210. 

The data memory 200 stores the (2N+1) samples <?(/) of each work window 
and comprises (2JV+ 1) registers, each having 16 bits. 

The work memories 201-203 are nonvolatile memories, for example ROM, 
PROM, EPROM, EEPROM or flash memories. 
20 In particular, the first work memory 201 stores the first signal feature Xl(i) 

and comprises (2N+1) sixteen-bit memory locations. Since the value of the first signal 
feature X\(i) for the z-th sample is constant in the various sample windows, as is evident 
from equation (1), the contents of the first work memory 201 must not be modified during 
the learning step or during operation of the neuro-fuzzy filter 1, and the first work memory 
25 20 1 may be implemented using any one of the technologies referred to above. 

The second work memory 202 stores the values of the two gaussian curves 
described by equation (2) according to the values of the signal features XI, XI, and JO. 
Since the values of these gaussian curves depend upon the second-layer weights WJl, k), 
W v (l, k), when a learning step is provided, the second work memory 202 must be of the 
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programmable type, for example of the EPROM, EEPROM or flash type. To avoid the use 
of a memory of excessive size, the gaussian functions (which represent the membership 
functions of the signal features XI, XI, X3, as discussed above) are stored as discrete 
values, according to the desired level of accuracy. For example, if the membership 
functions have 256 values, with an accuracy of 16 bits per value, considering two sets of 
fuzzy rales for each signal feature XI, XI, and X3, the second work memory 202 must have 
a storage capacity of 256 x 16 x 6 bits. The second work memory 202 is then addressed 
starting from the current values (corresponding to the i-th sample) of the signal features XI, 
X2, X3 supplied by the first work memory 201 and by the signal features calculation 
module 205, and outputs (to the first-layer output memory unit 207) the values of the six 
first-layer outputs oL\{m). 

The third work memory 203 stores the second-layer weights W FA (m, n) and 
the third-layer weights W DF {n). Since the third-layer weights W DF {ri) are generally modified 
during the learning step, the third work memory 203 is of a programmable type, as is the 
second work memory 202. In detail, if there are Mx N second-layer weights W FA (m, n) and 
N third-layer weights W DF {n), the work memory 203 comprises (16 x Mx N+ 16 x AO bits. 

The signal features calculation module 205 comprises a hardware network 
(not shown) represented as divided into a first part 205a for calculating the second signal 
feature X2(i) and a second part 205b for calculating the third signal feature X2(i). In the 
signal features calculation module 205 the operations represented by equations (2) and (3) 
are performed, and this module comprises a sample memory (having 2N + 1 locations), a 
unit for calculating the average value av, a unit for calculating the maximum of the 
differences between all the input samples and the central sample max{diff), a unit for 
calculating the maximum of the differences between all the input samples and the average 
value max{diff_av), and a unit for calculating the fractions defined by equations (2) and (3). 

The first-layer output memory unit 207 comprises six registers 212 which 
store the first-layer outputs oL\(m) supplied by the second work memory 202. 

The second-layer output calculating unit 208 comprises two modules, 
namely, a first multiplication module 208a and a minimum module 208b. In detail, the first 
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multiplication module 208a includes six first multiplication units 213 each of which 
multiplies a respective first-layer output oL\(m) (supplied by the first-layer output memory 
unit 207) by n respective second-layer weights W FA {m, n) (supplied by the second work 
memory 203); the second multiplication module 208b includes six minimum units 214 
which, starting from the six respective products oL\(m) x W FA {m, »), calculate the 
minimum thereof, supplying at the output a respective second-layer output oL2(n). 

The reconstruction-weight calculating unit 209 comprises two modules, 
namely, a second multiplication module 209a and a defuzzification module 209b. In detail, 
the second multiplication module 209a includes six second multiplication units 215 which 
multiply a respective second-layer output oL2(n), supplied by the second-layer output 
calculating unit 208, by a respective third-layer weight W DF (n), supplied by the third work 
memory 203. The defuzzification module 209b calculates the reconstruction weights oL3, 
adding the products supplied by the second multiplication module 209a, adding together the 
second-layer outputs oL2(n), and calculating the ratio between the two sums in accordance 
with equation (6). 

The reconstruction unit 210 stores the reconstruction weights oL3(i) as these 
are supplied by the reconstruction-weight calculating unit 209 and, as soon as it has stored 
2N+ 1 reconstruction weights oL3, it calculates the output sample u(2N+ 1) in accordance 
with equation (7), also using the values of the 2N+ 1 samples supplied by the data memory 
200. Subsequently, upon receipt of the next reconstruction weight oL3(2N+2), it 
calculates the output sample u(2N+ 2) using also the previous 2N reconstruction weights 
oL3 and as many samples coming from the data memory 200, in accordance with equation 
(7). 

The control unit 206 determines the processing sequence and data 
loading/transfer between the various units and modules. To calculate a single output 
sample, the control unit repeats the sequence of steps of the fuzzy algorithm 2N+ 1 times, 
updates the data memory 200 at the end of 2N + 1 cycles, and controls loading of 
successive 2JV+ 1 samples. 
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The advantages of the method and filter illustrated herein are described 
below. First, the method and filter reduce the noise of the input signal, whether the noise in 
question is of a white type or of a colored type, and enable separation of signals having 
different features. The filter preserves the steep edges of the signals without causing any 
losses of signal features, as is evident from a comparison between Figures 10A, 10B, and 
IOC. In particular, Figure 1 OA is a plot of a non-noisy voice signal (namely, a signal 
fragment corresponding to the vowel "e," with sampling at 44.1 kHz and a 16-bit A-D 
conversion resolution); Figure 1 OB is a plot the same signal as in Figure 10A, in presence 
of white noise; and Figure IOC shows the result of filtration of the signal of Figure 10A 
using the filter device 95 of Figure 7. 

Since the filter can be trained, it can be adapted to a specific type of initial 
signal and can be subsequently modified if so required. For example, the filter can be 
initially adapted to a first type of acoustic signal (for instance, a male voice with white 
noise, training being performed with two signals, one in the presence of white noise and 
one in the absence of noise). Then, the learning step can be repeated for signals of a 
different type, for example a female voice. The new weights thus calculated can replace the 
previous ones or be stored in addition to the previous ones; in the latter case, the control 
unit 206 controlling the filter 1 can control sending, to the units 207-209 (Figure 9), either 
of the first or of the second samples according to the use of the filter. 

Finally, it is clear that numerous variations and modifications may be made 
to the method and filter described and illustrated herein, all falling within the scope of the 
invention, as defined in the annexed claims. 

From the foregoing it will be appreciated that, although specific 
embodiments of the invention have been described herein for purposes of illustration, 
various modifications may be made without deviating from the spirit and scope of the 
invention. Accordingly, the invention is not limited except as by the appended claims. 
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